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TAPPING TO CREATE WRITING 

Background of the Invention 

Some personal computers allow a user to "write" on their computer 
5 display much as they would write on their notepad. One such computer is a tablet PC 
which typically includes the functionality of a laptop computer but including more input 
features. For example, a tablet PC allows multi-modal input in which a user can input 
information into the tablet by writing on the touch screen with a pen, using a keyboard, 
or even using their voice. A user can take notes just as they would using traditional pen 
10 and paper. Handwriting recognition allows the user's handwriting to be converted into 
digital text. It is sometimes difficult, however, to distinguish between handwriting and 
drawing input. 

Summary of the Invention 

The present invention is directed towards a method and system for 
1 5 tapping to create document structure. 

According to one aspect of the invention, a tap from the user is used to 
indicate to a writing application that the user is about to write in a certain location on 
the page. While in pen mode, the user taps the pen, the gesture recognizer tells the 
writing application that a "tap" has occurred, and the writing application creates a new 
20 paragraph with an active writing guide attached to it at that location. 

According to another aspect of the invention, when writing is already 
present, a tap after the existing writing creates a new paragraph. The new paragraph 
may be located at an indent level relative to the writing depending on the location of the 
tap. 

25 According to yet another aspect of the invention, a tap from the user is 

used to indicate to a writing application that the user is about to draw in a certain 
location on the page. 
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Brief Description of the Drawings 

FIGURE 1 illustrates an exemplary computing devices that may be used 
according to exemplary embodiments of the present invention; 

FIGURE 2 shows an exemplary screen including a handwriting guide; 

FIGURE 3 shows a process for tapping to create document structure; 

FIGURE 4 illustrates a process for determining a tap; 

FIGURE 5 illustrates a process for placing a writing guide at an 
indention level using a tap; and 

FIGURE 6 shows an exemplary screen with writing locations indicated 
using a tap, in accordance with aspects of the invention. 

Detailed Description of the Preferred Embodiment 

Generally, the present invention is directed towards a method and system 
for tapping to create document structure. A tap received from a user is interpreted by a 
writing application to indicate that the user is about to write in a certain location on the 
page. According to another embodiment, the tap is used to indicate to the writing 
application that the user is about to draw in a certain location on the page. While in pen 
mode, the user taps the pen, the gesture recognizer tells the writing application that a 
"tap" has occurred, and the writing application creates a new paragraph with an active 
writing guide attached to it at that location. A tap below the text creates a new 
paragraph. The new paragraph may be located at any available indent level based on 
the location of the tap. While the examples presented herein primarily refer to tapping 
to create writing, the tapping may also be used to indicate to an application to create any 
type of document structure. For example, the tapping may be used to indicate to the 
application to create a drawing near the location of the tap. 

Illustrative Operating Environment 

With reference to FIGURE 1, one exemplary system for implementing 
the invention includes a computing device, such as computing device 100. In a very 
basic configuration, computing device 100 typically includes at least one processing 



unit 102 and system memory 104. Depending on the exact configuration and type of 
computing device, system memory 104 may be volatile (such as RAM), non- volatile 
(such as ROM, flash memory, etc.) or some combination of the two. System memory 
104 typically includes an operating system 105, one or more applications 106, and may 
5 include program data 107. A pen and ink interface allows a user to enter writing 

directly on the touch screen. In one embodiment, application 106 may include a writing 
application 120. This basic configuration is illustrated in FIGURE 1 by those 
components within dashed line 108. 

Computing device 100 may have additional features or functionality. 

10 For example, computing device 100 may also include additional data storage devices 
(removable and/or non-removable) such as, for example, magnetic disks, optical disks, 
or tape. Such additional storage is illustrated in FIGURE 1 by removable storage 109 
and non-removable storage 110. Computer storage media may include volatile and 
nonvolatile, removable and non-removable media implemented in any method or 

1 5 technology for storage of information, such as computer readable instructions, data 
structures, program modules, or other data. System memory 104, removable 
storage 109 and non-removable storage 1 10 are all examples of computer storage 
media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, 
flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or 

20 other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other 
magnetic storage devices, or any other medium which can be used to store the desired 
information and which can be accessed by computing device 100. Any such computer 
storage media may be part of device 100. 

Computing device 100 also includes input device(s) 1 12 such as a touch 

25 screen input device, a stylus (pen), voice input device (speech recognition), an on- 
screen keyboard and writing pad, keyboard, mouse, etc. For example, a user could use 
the pen and writing pad to input their handwritten text into applications, and/or use the 
pen with the on-screen keyboard. Computing device 100 may also include Output 
device(s) 1 14 such as an external display, speakers, printer, etc. may also be included. 
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Computing device 100 may also contain communication connections 116 
that allow the device to communicate with other computing devices 118, such as over a 
network. An exemplary communications connection is a wireless interface layer that 
performs the function of transmitting and receiving wireless communications. The 
5 wireless interface layer facilitates wireless connectivity between computing device 100 
and the outside world. According to one embodiment, transmissions to and from the 
wireless interface layer are conducted under control of the operating system. 

Communication connection 1 16 is one example of communication 
media. Communication media may typically be embodied by computer readable 
10 instructions, data structures, program modules, or other data in a modulated data signal, 
such as a carrier wave or other transport mechanism, and includes any information 
delivery media. The term "modulated data signal" means a signal that has one or more 
of its characteristics set or changed in such a manner as to encode information in the 
signal. By way of example, and not limitation, communication media includes wired 

) 

15 media such as a wired network or direct- wired connection, and wireless media such as 
acoustic, RF, infrared and other wireless media. The term computer readable media as 
used herein includes both storage media and communication media. 

Tapping to Create Writing Guides 

20 FIGURE 2 shows an exemplary screen including a handwriting guide, in 

accordance with aspects of the invention. As shown, screen 200 includes, node handle 
210, writing guide 220, current line guides 230, and writing 235. 

A handwriting guide is a user interface element for creating structured 
handwritten notes. Generally, a handwriting guide is created when a user taps in a 

25 location where there is no other content. In other words, a handwriting guide is created 
when the user taps on an empty part of the screen where no other writing ink, drawing 
ink, or menus are located. In the present example, writing guide 220 appeared after a 
user tapped their pen on an empty location of screen 200 near the location of where 
node handle 210 currently is shown. 
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The handwriting guide serves two main purposes. First, the handwriting 
guide provides the user confirmation that the new ink will be considered handwriting 
and not a drawing. Second, the handwriting guide helps the user to write in a more 
controlled fashion. Guide 220 assists the user to write horizontally in straight lines 
5 instead of at arbitrary angles at the edge of the page and in widely varying sizes. Guide 
220 also helps to ensure that handwritten words have more consistent and recognizable 
base lines. As a result, the user creates handwriting that is more recognizable by the 
writing application. 

The handwriting guide appears after the user taps at a location on the 
10 screen that does not have content. As the user continues to write and create more 
written structure, the guide shows the user the structure they have created in their 
document, and where they can write to add onto the structure or start a new document 
structure. As they work through their document, the guides indicate the size and shape 
of their paragraph, changing size to indicate indent levels and multiple line paragraphs. 
15 While the use of guides provides many benefits to the writing experience, the use of the 
guides is optional. 

FIGURE 3 shows a process for tapping to create document structure, in 
accordance with aspects of the present invention. 

After a start block, the process moves to block 310, where the user 
20 places the pen down on the touch screen and the raises the pen up off of the touch 
screen. 

Moving to block 320, a determination is made to identify the gesture. 
Generally, the gesture is considered a tap when the user places the pen down on the 
screen for a short period of time within a small dimension of the screen (See FIGURE 
25 4). 

Flowing to decision block 330, a determination is made as to whether the 
gesture is considered a tap. 

When the gesture is a tap, the process moves to block 340 where new 
document structure is inserted. According to one embodiment, the tap is used to 
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indicate that writing will be created. According to another embodiment, the tap is used 
to indicate that a drawing will be created. 

According to one embodiment, the process moves to block 345 where a 
writing guide is inserted. According to one embodiment of the invention, the writing 
5 guide may be inserted at the location of the tap, or at the appropriate indent level. For 
example, when a tap is located directly below the left edge of the text on the screen, 
then the writing guide is inserted on the next available writing line with no indentation. 
When the tap is offset from the writing guide and below the existing text, then the 
writing guide is placed at the appropriate indent level. The process then moves to an 
10 end block. 

When the gesture is not a tap, the process moves to block 350 where ink 
is drawn. The process then moves to an end block. 

FIGURE 4 illustrates a process for determining a tap, in accordance with 
aspects of the invention. After a start block, the process moves to block 410 where the 
15 speed and dimension of the gesture is determined. The speed and dimension of the 
gesture determine whether the gesture may be classified as a tapping gesture. For 
example, the dimension of the tap may indicate a dash (-). The speed of the gesture 
helps to determine if the pen was placed briefly down on the screen. 

Moving to decision block 420, a determination is made as to whether the 
20 gesture may initially be classified as a tap based on the speed and dimension of the 
gesture. 

When the gesture is initially classified as a tap, the process moves to 
decision block 430 to determine if there is any content on the screen at the location of 
the tap. 

25 When there is content at the tap location the process moves to block 440 

and the gesture is classified as a non-tap. For example, the tapping gesture may be 
located over a menu. The process then moves to an end block. 

When there is no content at the location of the tap, the process moves to 
block 450, where the gesture is classified as a tap. The process then moves to an end 

30 block. . 
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FIGURE 5 illustrates a process for placing a writing guide at an 
indention level using a tap, in accordance with aspects of the invention. 

After a start block, the process flows to block 510 where the horizontal 
offset of the tap is determined relative to the horizontal location of the pre-existing 
5 writing start location of the writing. According to one embodiment of the invention, the 
left hand side of the existing writing directly above the tap is used as the starting 
horizontal location. For right-to-left languages, the right hand side could be used. 

Transitioning to decision block 520, a determination is made as to 
whether the tap is located at a new indentation level. Indentation levels may be based 
10 on any predetermined horizontal offset (the "indent distance") between the tap and the 
existing text. For example, the indentation levels could be set at half inch intervals. 
According to one embodiment, tapping into an indent level for the first time sets the 
indent distance for that level for the rest of the writing. After an indent level is 
established, a small amount of ink overlap with the space that occupies the previous 
15 level is allowed. Too much overlap, however, and the indent goes to the next higher 
level. According to one embodiment, the indent distance is set to be at the left most 
point of the first ink stroke drawn into that level minus 0.1 times the current line height. 

When the difference is less than the indent distance, the process moves 
to block 530 where a new paragraph is created by inserting the writing directly 
20 underneath the pre-existing writing without any offset. The process then moves to an 
end block. 

When the difference is greater than or equal to the indent distance, the process flows to 
block 540 where writing is placed at the new indention level. The process then moves 
to an end block. 

25 FIGURE 6 shows an exemplary screen with writing locations indicated 

using a tap, in accordance with aspects of the invention. 

Structured text is shown with writing 605 and writing 615. In this 
example, the writing guides are shown with optional next indent level indicators 625 
and 630. Indent level indicator 625 shows the user where to tap to create a second level 

30 writing guide and indicator 630 shows the user where to tap to create a third level 
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writing guide. Node handle 635 and current line guides 640 indicate that the second 
level is the current writing level for the text. As can be seen, active writing guide 620 is 
indented from first level writing guide 610. The user may extend the indentation level 
by tapping on the line after second level writing guide 620. The indent level may be 
5 increased or decreased based on the location of the tap. According to one embodiment, 
as indent levels are established, subsequent indent level indicators automatically line up 
with previous indents within the text to correct for user error. 

When the user taps on text, then the tap gesture is recognized by the 
gesture recognizer as a left click. This allows the user to move or clear the text. 

10 Text 650 and text 660 show two paragraphs created by tapping. Node, 

handle 670 and current line guides 675 show the user the active writing line. In this 
example, writing guide 655 and active writing guide 665 are at the same indentation 
level. When the user initially taps on an empty screen, the writing guide is placed at the 
first level. For the next line, the user can either tap into the first level, or start a new 

15 level . If text is already present, a tap below the text creates a new paragraph, which 
could be at any available indent level. 

The above specification, examples and data provide a complete 
description of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and scope 

20 of the invention, the invention resides in the claims hereinafter appended. 
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